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We present a stability analysis of the 2D t — t' Hubbard model on a 
square lattice for t' = —t/6. We find possible phases of the model (d- 
wave Pomeranchuk and superconducting states, band splitting, singlet and 
triplet flux phases), and study the interplay of them. 
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1. Introduction 

In recent years the two-dimensional (2D) Hubbard model has been used 
as the simplest model to describe the electron correlations in the copper- 
oxide planes of high-temperature superconductors since experimental data 
suggest that superconductivity in cuprates basically originates from the 
Cu02 layers. Apart from the antiferromagnetism and dj.2_y2-wave super- 
conductivity, a few other instabilities related to symmetry-broken states [1, 
2, 3, 4, 5, 6] and occurring together with them in the 2D t — t' Hubbard 
model with next-nearest-neighbor hopping t' have been reported. They are 
the flux phase[l, 2] or d-wave density order [4], the triplet flux phase [6], 
the d-wave Pomeranchuk instability [3] and band splitting [5]. Ferromag- 
netism and p-wave triplet superconductivity have been observed also by the 
authors of Refs. [7, 8, 9, 10] and Ref. [10] respectively at certain region of 
electron concentration around the Van Hove filling (where the Fermi surface 
passes through the saddle points of the single particle dispersion) for large 
negative values t' . 

However, the competition and interplay of these phases remain an open 
problem. In this paper we investigate superconducting and other possible 
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instabilities of the 2D t — t' Hubbard model at small negative value of t'. 
We consider also the leading instabilities depending on the ratio U/t (in the 
papers cited above it was fixed). 

We start from the Hamiltonian of the t — t' Hubbard model 

H = 5^ekicka + ^Y1 4iTCkiT42iCkii^ki+k2,ki+k^, (1) 

k(T kjk'j^ 
k2k^ 

where is the Bloch electron energy with the momentum k, cj^g.(ckcr) is 
the creation (annihilation) operator for the electrons with spin projection 
a G {t,i}, U is the local Coulomb repulsion of two electrons of opposite 
spins, N is the number of lattice points, lattice spacing equals unity. For a 
square lattice the single particle dispersion has the form 

£k = — 2t(cos kx + cos ky) — At' cos kx cos ky. (2) 

By means of the flow equation method [11] the Hamiltonian is trans- 
formed into one of molecular-field type. This Hamiltonian is calculated in 
second order in the coupling U [5] . Adopting the notations of Ref . [5] , free 
energy can be expressed by the order parameters Ak in the form: 




where the first term is the energy contribution and the second term is the 
entropy contribution, (5 = l/^ksT), T is the temperature, t is the hopping 
integral of electrons between nearest neighbors of the lattice, Vk,q is effective 
second-order interaction, and /k is an entropy coefficient. All quantities of 
Eq. (3) are defined in Ref. [5]. 

We start from the symmetric state and investigate whether this state is 
stable against fiuctuations of the order parameters A. As soon as a non- 
zero A yields a lower free energy in comparison with the symmetric state 
A = 0, then the symmetric state is unstable and the system will approach 
a symmetry broken state. This indicates a phase transition. 

2. Results and discussion 

We perform numerical calculation on a square lattice with 24 x 24 points 
in the Brillouin zone for the various representations under the point group 
C4jy. Initially, such numerical calculations have been performed in Refs. [5, 
12] for the 2D Hubbard model, but they were sensitive to the lattice size 
at low temperatures. Here we use an improved scheme (for details see 
Ref. [13]). 
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Apart from antiferromagnctism at small t' and half-filling, one of the 
leading instabilities at small doping is a Pomeranchuk instability with (1^2 _y2- 
wave symmetry in the singlet channel (see Fig. 1). The corresponding eigen- 
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Fig. 1. Temperature phase diagram of the model at = — 1/6 for n = 0.95 (a) 
and n = 0.86 (b). SC stands for superconductivity, BS for band splitting, PI for 
Pomeranchuk instability, FP for flux phase, and TFP for triplet flux phase. 



vector signals a deformation of the Fermi surface which breaks the point 
group symmetry of the square lattice from tetragonal to orthorhombic. At 
high temperatures the system has a tetragonal structure and an orthorhom- 
bic one at low temperatures. One can see from Fig. 1 that at the values 
[/ > 6t the critical temperature of this transition decreases with increasing 
the hole doping (5 = 1 — n (n is the electron concentration). It means that 
the hole doping enhances the tendency towards an orthorhombic distortion 
of the Fermi surface (or lattice). The d^2_yi-^WQ Pomeranchuk instability 
dominates at the Van Hove filling (Fig. lb). 

The next instability, which is developed in the region of electron con- 
centration around half-filling and is one of the strongest in that region, is a 
particle-hole instability of singlet type with staggered p-wave symmetry. It 
yields [5] a splitting into two bands and may lead to an energy gap in the 
charge excitations spectrum. Other instabilities are the singlet and triplet 
flux phases. In contrast to the case of t' = 0, where the singlet and triplet 
Tc of the particle-hole instabilities with staggered symmetry of d^2_y2-weive 
character are degenerate (that is the flux phase) , they are different at t' ^ 
and the triplet one is higher. 

The superconducting dx2_y2 instability is the strongest one at small dop- 
ing and low temperatures. It is not destroyed at sufficiently large doping as 
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well as large values of At weak coupling U < 5t and close to half-filling 
the transition from a paramagnetic phase to superconducting one can occur 
at very low temperatures (Fig. lb). The peculiar feature of the supercon- 
ducting phase should be noted. Away from the Van Hove filling (at the Van 
Hove filling the density of states has a singularity, Fig. lb corresponds to 
this situation) when temperature approaches zero the curves corresponding 
to superconducting phase arc flat, whereas the curves corresponding to all 
other phases observed become steep. Therefore, at very low temperatures 
the transition from a paramagnetic phase to the superconducting one can 
occur at very small values of the corresponding effective interaction in con- 
trast with the transitions to other possible phases which require some finite 
values of the effective interactions. One can see also that the critical tem- 
peratures of all phases increase with the increase of correlation strength U/t. 
Thus, electron correlations enhance the tendency towards the transition to 
the phases observed by us. 

In conclusion, we have presented a stability analysis of the 2D t — t' 
Hubbard model on a square lattice. Wc have found possible phases of the 
model (d-wave Pomeranchuk and superconducting states, band splitting, 
singlet and triplet flux phases), and studied the interplay of them. One 
phase may suppress another phase. To which extend two order parameters 
can coexist with each other is a question, which has to be investigated in 
the future. 
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